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ABSTRACT 


The  controlled  signalling  system  is  a  finite-state  deterministic  model  of  information 
disclosure  on  a  computer  system.  The  model  includes  high-level  and  low-level  coop¬ 
erating  processes.  The  processes  cooperate  to  covertly  send  data  from  the  high-level 
process  (transmitter)  to  the  low-level  process  (receiver).  The  capacity  of  a  controlled 
signalling  system  is  a  measure  of  the  amount  of  information  the  high-level  process  can 
disclose  to  the  low-level  process.  The  serial  product  is  a  binary  operation  on  the  class 
of  controlled  signalling  systems.  The  capacity  of  the  serial  product  of  two  controlled 
signalling  systems  can  be  strictly  greater  than  the  capacities  of  the  individual  systems. 
The  r-controUed  signalling  systems  are  a  subclass  of  controlled  signalling  systems;  for 
r-controlled  signalling  systems,  the  serial  product  capacity  is  the  maximum  of  the  indi¬ 
vidual  capacities. 


ACKNOWLEDGMENTS 


This  work  was  supported  by  the  National  Security  Agency  under  Contract  F19628- 
89-C-OOOl  and  completed  under  MITRE  Project  8350.  I  wish  to  thank  Todd  Wittbold 
for  the  many  helpful  discussions  concerning  controlled  signalling  systems  and  the  mate¬ 
rial  in  this  paper.  I  would  also  like  to  thank  both  Dale  Johnson  for  some  useful  advice 
on  I^TEXand  Jon  Millen  for  some  helpful  comments. 


TABLE  OF  CONTENTS 


SECTION  PAGE 

1  Introduction  1 

2  Controlled  Signalling  Systems  3 

3  Serial  Products  and  An  Example  14 

4  r-ControUed  Signalling  Systems  24 

List  of  References  33 

Distribution  List  35 


V 


SECTION  1 
INTRODUCTION 


This  paper  is  concerned  with  products  of  controUed  signalling  systems;  a  con¬ 
trolled  signalling  system  is  a  deterministic  finite- automata  model  with  two  players,  or 
processes.  This  model  was  developed  by  Wittbold  in  [5].  The  programs  cooperate  in 
order  to  covertly  send  data  from  one  process,  the  transmitter,  to  the  other  process, 
the  receiver.  Controlled  signalling  systems  illustrate  the  potential  for  application  of 
graph-theoretic  and  information-theoretic  techniques  to  modelling  problems  in  com¬ 
puter  security.  Since  the  work  in  this  paper  is  concerned  with  products  of  controlled 
signalling  systems,  we  will  briefly  review  controlled  signalling  systems  and  some  of  the 
main  results  of  [5].  Further  details  are  in  given  in  Section  2. 

The  controlled  signalling  system  is  a  finite-state  deterministic  model  with  a  high-level 
process  acting  as  transmitter  and  a  low-level  process  acting  as  receiver.  The  transmitter 
and  receiver  alternate  turns;  a  turn  consists  of  an  input  into  the  finite-state  automata 
and  an  output  delivered  to  the  input  source  (transmitter  or  receiver.)  The  transmitter 
is  able  to  send  information  to  the  receiver,  since  its  turns  affect  the  state  of  the  system, 
and,  hence,  the  receiver’s  output  is  affected  by  the  transmitter’s  inputs.  The  receiver 
is  not  allowed  to  directly  view  the  transmitter’s  inputs  and  outputs.  The  goal  of  the 
spies  who  have  installed  the  programs  is  to  maximize  the  rate  of  information  flow  from 
the  transmitter  to  the  receiver.  In  a  controUed  signalling  system,  the  receiver  chooses 
a  sampUng  strategy  (a  policy);  under  a  fixed  strategy,  the  receiver’s  next  input  is  a 
function  of  the  receiver’s  preceding  inputs  and  outputs.  Each  fixed  strategy  gives  rise 
to  a  di.:icrete  noiseless  channel,  ([4]);  the  capacity  of  the  controUed  signaUing  system  is 
defined  as  the  supremum  of  the  capacities  of  the  induced  discrete  noiseless  channels. 
The  problem  of  choosing  the  optimal  poUcy  is  solved  in  [5]. 

The  coding  theorem  of  [5]  (Theorem  2.1)  shows  that  block-poUcy  codes  with  rates 
arbitrarUy  close  to  the  capacity  of  the  system  exist;  these  codes  are  expUcit  algorithms 
for  communication  between  transmitter  and  receiver.  It  is  also  proved  that  no  block- 
poUcy  codes  with  rates  exceeding  the  capacity  can  exist.  A  key  result  (Theorem  2.2)  of 
[5]  is  the  optimaUty  equation: 

t 

where  V"(s)  is  the  maximum,  over  aU  strategies,  of  the  number  of  length  n  output 
words  that  can  be  produced  under  a  fixed  strategy  starting  with  a  signal  of  type  s,  and 
/i(r,s,l)  is  the  control  array  for  the  controUed  signaUing  system.  This  equation  aUows 
one  to  compute  optimal  strategies  and  associate  a  piecewise  Unear  operator  $  with  the 
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controlled  signalling  system.  For  positive  control  arrays,  the  capacity  of  the  controlled 
signalling  system  is  the  log  of  the  largest  eigenvalue  of  this  associated  operator. 

In  this  paper,  we  study  products  of  controlled  signing  systems.  The  product  of  two 
controlled  signalling  systems  Si  and  S2  is  obtained  by  taking  unions  of  the  transmitter 
and  receiver  alphabets  and  taking  the  Cartesian  product  of  the  sets  of  states.  A  state 
transition  resulting  from  an  input  in  Si  is  accomplished  by  allowing  the  «Si  component 
of  the  state  to  change  as  it  would  in  <Si  while  the  S2  component  of  the  state  remains 
unchanged.  The  output  delivered  to  the  inputting  process  is  the  same  as  would  be 
delivered  in  Si  given  the  same  input  and  Si  component  of  the  state.  The  analogous 
statement  holds  for  inputs  in  ^2.  An  intuitively  plausible  formula  is 

cap(Si  X  52)  =  max{cap(5i),cap(52)}  (1) 

where  cap{S)  is  the  capacity  of  a  controlled  signalling  system  S.  We  give  an  example  in 
section  3  to  show  that  (1)  does  not  hold  for  controlled  signalling  systems.  In  section  4,  we 
investigate  a  subclass  of  controlled  signalling  systems,  the  class  of  r-controUed  signalling 
systems.  For  r-controlled  signalling  systems,  the  transmitter  edges  have  a  transitive 
closure  property.  In  this  case,  we  derive  a  new  control  array  and  prove  equation  (1). 
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SECTION  2 

CONTROLLED  SIGNALLING  SYSTEMS 


This  section  is  devoted  to  a  careful  review  of  the  key  results  on  controlled  sig¬ 
nalling  systems  from  [5].  The  controlled  signalling  system  is  a  finite-state  deterministic 
model  of  information  transfer  from  one  process  in  a  computer  system,  the  transmitter, 
to  another  process,  the  receiver.  Each  process  has  an  input  alphabet  and  an  output 
alphabet;  the  processes  alternate  turns.  A  turn  consists  of  a  process  input,  a  change  of 
state  determined  by  the  input  and  current  state,  and  an  output  similarly  determined 
2uid  delivered  to  the  Inputting  process.  A  process  has  no  knowledge  of  the  other  pro¬ 
cess’s  outputs.  We  interpret  the  evolution  of  the  turns  as  a  game  in  which  both  processes 
cooperate  to  maximize  information  flow  to  the  receiver.  We  now  give  a  precise  definition. 


Definition  2.1  (Controlled  Signalling  System)  A  controUed  signalling  system  is  a 
7-tuple  {S,lT,lR,0,next,out,ao)  where 

1.  5  is  a  finite  nonempty  set  of  states. 

2.  Ir  and  It  are  finite  disjoint  nonempty  sets  of  input  symbols  for  the  receiver  and 
transmitter,  respectively.  I  —  Ir\J  Ij. 

3.  0  is  a  finite  nonempty  set  of  output  symbols. 

4.  next  :  5  X  /  — *  5  is  a  function  determining  the  next  state  from  the  current  state 
and  current  input. 

5.  out  :  S  X  I  -*  0  determines  the  current  output  from  the  current  state  and  current 
input. 

6.  oo  €  5  is  the  initial  state. 

We  will  sometimes  write  si  in  place  of  neit(s,  i)  where  s  €  5  and  i  G  I. 


In  [5],  the  following  question  is  tackled:  if  the  receiver  is  going  to  submit  inputs  based 
on  a  fixed  strategy  (a  strategy  is  a  function  from  the  receiver’s  previous  sequence  of 
inputs  and  outputs  into  the  set  of  inputs),  how  can  the  receiver  choose  a  strategy  which 
maximizes  information  flow  from  the  transmitter  to  the  receiver?  Given  the  definition 
of  receiver  strategies,  a  natural  definition  of  the  capacity  of  controlled  signalling  systems 
was  given  in  [5].  In  order  to  make  this  paper  self-contained,  we  now  give  these  definitions. 
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Definition  2.2  (Receiver  Strategy)  A  receiver  strategy,  or  policy,  is  a  sequence  of 
functions 

JT  =  ITi,  T2,  .  .  . , 


such  that  for  each  n  >  1, 


:  {Ir  X  O)"-*  -  Ir. 


Intuitively,  we  think  of  the  receiver  submitting  inputs  I'l , . . . ,  i„_i  on  turns  , . . . ,  <n-i 
and  receiving  outputs  oi,. .  where  turn  ti  is  the  initial  turn  of  the  system.  The 

receiver  input  for  turn  t„  under  strategy  ir  is 

»  *2^’  *  •  •  t  ffi— 1  ®n— 1  )• 


A  controUed  signalling  system  with  fixed  receiver  strategy  x  maps  naturally  to  a 
discrete  noiseless  channel.  In  [5],  the  capacity  of  a  controUed  signalling  system  is  defined 
to  be  the  supremum  of  the  capacities  of  the  associated  discrete  noiseless  channels. 


Definition  2.3  (Discrete  Noiseless  Channel)  A  discrete  noiseless  channel  is  a  triple 
C  =  (7,0,1-),  where 

1.  /  is  a  finite  set  of  input  symbols. 

2.  O  is  a  finite  set  of  output  symbols. 

3.  I-:  7*  — ►  O*  is  a  function  mapping  strings  of  input  symbols  to  strings  of  output 
symbols  such  that: 

(a)  h:  r  -  O". 

(b)  If 

X  —  X\ , .  .  . ,  Xfii 

and 

y  —  X\,.  .  Xtnt  J/m+1 1  •  •  •  5  Vm+k 

are  strings  of  input  symbols  where  k  >  1,  we  say  that  y  is  an  extension  string 
of  i;  we  denote  this  fact  by  x  <  y.  If  x  <  y,  then  H  (x)  <  h  (y). 


We  now  reproduce  the  definition  of  capacity  for  a  discrete  noiseless  channel: 
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Definition  2.4  If  >1  is  a  finite  set,  we  let  |>1|  denote  the  cardinality  of  the  set  A.  All 
logarithms  will  be  to  the  base  2.  If  C  =  (/,0,h)  is  a  discrete  noiseless  channel,  we 
define 


cap(C)  =  limsup 

n— *00 


iog(l  I-  (/")!) 

n 


We  now  give  the  map  wliich  associates  a  fixed  receiver  strategy  for  a  controlled 
signalling  system  S  with  a  discrete  noiseless  channel. 


Proposition  2.1  ([5])  Let  <5  be  a  controlled  signalling  system  and  a  ^  S  &  state  of  S. 


be  a  receiver  strategy.  Then  for  each  n  >  1  and  each  hi, . .  .,/i„  €  /jr,  there  are  unique 
sequences  sq.  •  •  •  >  6  and  t'lOi  . .  .I'nOn  €  (//?  x  O)"  such  that  the  following  system 

of  equations  is  satisfied; 

1.  =  a, 

2.  St  —  St—\htit  1  t  ^  ri, 

3.  »(  =  . .  .it-iOj-i)  1  <  t  <  n,  and 

4.  ot  =  otit(st_iht,i()  1  <  t  <  n. 

In  the  above  proposition,  we  say  that  (I'lOi  satisfies  the  system  equations 

for  x  with  initial  condition  a  and  transmitter  input  string  hih2-  -h„.  The  following 
proposition  is  an  immediate  consequence  of  Proposition  2.1. 


Proposition  2.2  1.  The  map  ^  defined  by  the  condition 

t-  (».a)  (*1  •  .  .ftn)  =  (»lOl  •  •  .  inOn) 

if  and  only  if  (iiOi . .  .i„On)  satisfies  the  system  equations  for  tt  with  initial  condi¬ 
tion  a  and  transmitter  input  string  hihj  . .  ./i„,  is  well-defined. 

2-  =  {ItiIr  X  >s  a  discrete  noiseless  channel. 

We  can  now  define  the  capacity  of  a  controlled  signalling  system. 
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Definition  2.5  Let  oq  be  the  initial  state  of  the  controlled  signalling  system  S.  We 
define 

Ch{S)  =  ^  ^  receiver  strategy}. 


The  capacity  of  S  is 


cap(S)  =  sup  cap(c). 
c€CA(5) 


Ch{S)  is  the  space  of  covert  channels  associated  with  the  controlled  signalling  sys¬ 
tem  S. 

We  will  shortly  define  blo,k-policy  codes  which  are  a  natural  extension  of  block 
cedes.  Given  the  definition  of  receiver  strategy  and  block-policy  codes,  Wittbold  ([5]) 
proves  a  coding  theorem  which  shows  that  the  definition  of  capacity  is  satisfactory.  The 
coding  theorem  states  that  there  are  no  block-policy  codes  with  rates  greater  than  the 
capacity  but  that  there  exist  codes  with  rates  as  close  to  the  capacity  as  desired.  We 
now  define  some  additional  notation. 


Definition  2.6  We  denote  the  set  of  all  receiver  strategies  by  11.  A  receiver  strategy, 
or  policy,  of  length  n  is  a  sequence  of  functions 

ff  =  TTi ,  )r2»  •  •  •  1 

such  that  for  each  k,  n  >  k  >  1, 

TT*  :  {Ir  X  0)*-'  -  Ir. 

We  let  n„  denote  the  set  of  receiver  strategies  of  length  n. 


Definition  2.7  If  {x„}  is  an  infinite  sequence,  we  define 

ratc{x„}  =  limsup  (2) 

n-»oo  n 

If  /  is  a  function  and  the  set  X  is  contained  in  the  domain  of  /,  we  define  f{X)  = 
{/(i)  :  X  f  A").  Let  <5  be  a  controlled  signalling  system,  a  €  5  a  state,  and  tt  a 
strategy  of  length  m,  where  m  >  n.  Proposition  2.1  holds  if  we  fix  n  and  replace  the 
receiver  strategy  with  a  receiver  strategy  of  length  m,  ni  >  n.  In  this  situation,  we 
say  that  (iiOi  . .  .inOn)  satisfies  the  system  equations  for  tt  with  initial  condition  a  and 
transmitter  input  string  hih2---hn.  Thus  the  map  ^  defined  by 

the  condition 

^ (ir,a)  (^1  •  •  -  kn)  =  (M^I  •  •  ■  •n^n) 
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if  and  only  if  (t'lOj . .  .t„o„)  satisfies  the  system  equations  for  t  with  initial  condition  a 
and  transmitter  input  string  hih2...hn,is  well-defined.  We  now  define 


a)  =!-(,,,)  (/?). 


We  also  define 

<r*(«S,a)  =  max  |Z)’*(5,7r,a)|, 

irglln 

d{S.a)  =  rat€{<r*(5,a)}, 
and 

D'‘(5,x)  =  I}"(5,T,ao). 

We  will  drop  the  <5  from  these  expressions  when  the  controlled  signalling  system  is 
obvious  from  the  context. 


Proposition  2.1  shows  that,  given  a  receiver  strategy  x  of  length  at  least  n  and 
state  a,  there  is  for  each  string  of  n  transmitter  input  symbols,  hih2  . .  .hn,  a  unique 
state  sequence  so«i  •••Sn-  We  define 

endpt(x,a’,  h\h2  . .  .hn)  = 

If  there  exist  hi,h2, . .  .,hm  €  /r  and  11,12,  ••  .,»m  €  Ir  such  that  b  =  oohi  11/12*2  •  •  ■/im*m) 
we  say  that  6  is  a  reachable  state. 

We  are  now  ready  to  give  the  definition  of  block-policy  codes. 


Definition  2.8  A  block-policy  code  is  a  5-tuple 

B  =  {b,ko,no,X,Tr) 

where  no,  ^0  are  integers.  Also, 

1 .  6  €  5  is  a  reachable  state,  the  basepoint  of  the  code. 

2.  X  €  n„<,  is  a  length  no  strategy. 

3.  A”  C  is  a  collection  of  codewords  satisfying 

(a)  |A1  =  2*«, 

(b)  is  1:1  on  X, 

(c)  If  /»ih2  •  • -/ino  €  A,  then  endpt(x,6; /»i/»2 ..  ./»«<,)  =  h. 
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The  rate  of  the  code  is  ko/riQ. 


Condition  (b)  ensures  the  receiver  will  know  what  transmitter  word  was  sent  from 
inspection  of  its  own  i-o  word.  Condition  (c)  ensures  that  the  system  will  return  to 
state  b  every  no  combined  transmitter  receiver  turns;  thus  repeated  concatenation  of 
the  finite  strategy  ir  with  itself  gives  an  infinite  strategy  that  transfers  data  at  the  rate 
of  ko  bits  every  no  turns. 

We  can  now  state  the  coding  theorem  of  [5]. 


Theorem  2.1  Let  <S  be  a  controlled  signalling  system  with  cap{S)  =  c  >  0.  We  then 
have 

1.  There  are  no  block-policy  codes  with  rates  greater  than  c. 

2.  For  each  e  >  0,  there  is  a  block-policy  code  with  rate  greater  than  c  -  c. 

3.  c  =  d(ao). 

The  proof  of  this  theorem  is  in  [5](pp.98-100). 

We  now  develop  the  necessary  framework  to  present  the  optimality  equation 
(Theorem  2.2).  The  optimality  equation  will  yield  a  dynamic  programming  approach 
to  computing  optimal  receiver  strategies;  in  combination  with  Theorem  2.3  (Bellman 
[1]),  it  yields  an  iterative  algorithm  for  computing  the  capacity  of  a  controlled  signalling 
system.  The  optimality  equation  is  an  inductive  formula  for  counting  receiver  input- 
output  strings  under  optimal  receiver  strategies;  the  key  to  this  approach  is  the  definition 
of  types.  The  types  definition  yields  an  equivalence  relation  on  receiver  input-output 
strings;  if  two  strings  are  equivalent,  they  have  the  same  “growth  properties.”  Also, 
there  are  only  a  finite  number  of  equivalence  classes.  We  will  now  make  these  remarks 
more  precise. 


Definition  2.9  For  each  n,  we  define 

Siff^(ao)=  U  B’'(jr,ao). 

Let  J3  =  ijoi .  €  (In  x  O)",  and  let  hi/»2  •  •  -  G  /?.  ^1^2  . .  ./in  is  consistent  with 

/?  if  and  only  if  there  exists  SqSi  ...s„€S"  such  that 

1.  So  =  oo. 
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2.  St  =  St-ihtit  I  <  t  <  n,  and 

3.  Of  =  out{st-\ht,it)  1  <t  <n. 

Definition  2.10  (Types)  Let  0  =  iiOi  ...tnO„  €  Sig^(ao).  0  is  called  a  receiver  out¬ 
put  string  of  length  n.  typ€{0)  =  {a  £  S  :  there  exists  6  Ij  such  that 

hih2  . .  .hn  is  consistent  with  0  and  oohiii . .  .h„i„  =  a}. 

The  equivalence  relation  on  receiver  output  strings  discussed  in  the  remarks  above 
defines  receiver  output  strings  0i  and  0^  to  be  equivalent  if  typ€{0i)  =  type{02).  The 
next  proposition  ensures  that  we  can  count  receiver  output  strings  by  type;  receiver 
output  strings  with  the  same  type  have  the  same  extension  strings,  and  these  extension 
strings  have  the  same  type. 

Let  ACS  and  »  €  Ir.  We  define 

0(i4,t)  =  {o£  O  :  there  exists  a  £  A,  h  £  It,  such  that  out{ah,  i)  =  o}. 

Proposition  2.3  (Growth  Properties)  Let /3i, /?2  be  receiver  output  strings  of  length 
n  where  type{0\)  =  type{02).  For  any  t  €  Ir  and  o  €  O,  we  have 

1.  0iio  £  5i<jf"‘^*(ao)  if  and  only  if  o  €  O{typ€{0\),i). 

2.  If  o  €  O{type{0i),i),  then 

type{0\io)  =  {s  €  S  :  there  exist  v  £  typ€{0\),  h  £  It, 
such  that  vhi  =  s  and  out{vh,i)  =  o}. 

3.  If  o  €  O{type{0i),i),  then  typ€{0iio)  =  typ€{02io). 

We  are  now  ready  to  define  the  control  array  of  a  controlled  signalling  system.  We 
will  obtain  a  piecewise  linear  operator  ^  :  RI'  —*  R"  such  that  the  capacity  of  the 
controlled  signalling  system  is  equal  to  log  A  where  A  is  the  largest  positive  eigenvalue 
of 

Definition  2.11  (Control  Array)  Let  be  a  controlled  signalling  system,  and  let 
ri , . . . ,  T/  be  an  enumeration  of  the  types  of  S.  Let  t'l , . . . ,  i a  be  an  enumeration  of  the 
receiver  input  alphabet.  We  define  the  following  array  of  integers  to  be  the  control  array 
of  S  : 

=  |{o  :  0irO  £  Sig^'*'^{ao),  0  has  length  n,  typ€{0)  =  s,  and  type{0iro)  =  t}]. 
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Proposition  2.3  shows  that  the  control  array  is  well-defined.  We  will  now  define  the 
Ext  functions  which  will  lead  us  to  the  optimality  equation  (Theorem  2.2). 

Definition  2.12  Let  Q  C  5j5"*(ao),  and  let  ffm+i  :  {Ir  x  0)"*  Ir.  We  define 

Ext^{Q-,ir„+i)  =  {/3)r„+i(/3)o:  /?  €  Q  and  o  e  0(typc(/?), 7r„+i(y9))}. 

Let  ffm-n»...,’rTO+n  be  functions  such  that  ffm+fc  :  (Ir  x  0)"*+*'“^  /fl,  1  <  A:  <  n. 
For  n  >  2  we  define 

Ext  (Qi  ITm+l  .  .  .  JTnv+n) — 

Ext^(^Ext^  ^(Q;  ff'm-t-l  •  •  •  ^m+n— 1 ))  ^Tm+n)- 


We  now  give  a  lemma  that  will  be  helpful  in  the  proof  of  Theorem  2.2. 

Lemma  2.1  Let  Qi  and  Q2  be  disjoint  subsets  of  Sig”'{ao).  Let  •  •  •’'’m+n* 

ir^  =  . .  .iTm-hfn  ’*■  —  ’•'m+i  •  •  .ffm+n  be  sequeuces  of  functions  such  that 

•  (^R  X  O)”*’*’*'*^  Ir  I  <  fc  <  n. 

Suppose  if  g  €  Qi  X  {Ir  x  0)*“^  I  <  k  <  n,  t  =  1,2.  We  then  have 

ExnQi  U  Q2;  ’r)  =  Exe{Qi;7r^)  IJ  Ext^iQ^;  tt^). 


We  now  define  the  V"  functions. 

Definition  2.13  We  define 

Ilm.n  =  [n  :  IT  =  TTto+I  ■  whcTC  Vm+k  '  {Ir  X  0)"*+*-^  -*  I R,  1  <  *:  <  n}. 

For  Q  C  Sig"'{ao)  and  n  >  1,  we  define 

V"(Q)=  max  \Exr{Q,n)\. 

We  also  define  V^(Q)  =  1.  When  we  want  to  make  the  dependence  of  V”  on  the 
controlled  signalling  system  S  explicit,  we  will  write  V’"(«S,  Q)  in  place  of  V^”(Q).  If 
Q  =  {/3},  we  write  V"(^)  in  place  of  V"(Q).  We  define  x  G  H^.n  to  be  n-optimal  for  Q 
if  and  only  if  \Ext^{Q;ir)\  =  ^"(<3). 


We  are  now  ready  to  present  the  optimality  equation. 
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Theorem  2.2  1.  Let  Q  C  Sig"'(ao),  and  let  ir  €  Il^.n-  ^  is  n-optimal  for  Q  if  and 

only  if  for  each  j3  €  Q,  ir  is  n-optimal  for  /3.  It  follows  that 

V^(Q)=Z^(^)’ 

P€Q 

2.  Let  €  5i^"*(ao).  For  all  n  >  0, 

V"+'(/3)  =  m«|  V-i/3io) 

3.  Let  5  be  a  controlled  signalling  system,  and  let  be  the  set  of  types 

for  S.  Let  Pi  and  /J2  be  elements  in  Sig"'{ao).  If  type{(3i)  =  type{(i2),  then 

Thus  V”  is  well-defined  on  the  set  of  types  for  n  >  0,  and 

^"+^5)=  m^  (  Y.  M(r;s,t)V”(t)  ■ 

U<«</ 

where  Ir  =  {ii . , .  ir}. 


This  theorem  is  proved  in  [5]. 

By  Theorem  2.1,  an  algorithm  to  compute  the  integers  (/"(oq)  =  max,rgn„  l-D"(jr,  ao)| 
will  yield  the  capacity  of  the  controlled  signalling  system  S.  If  we  let  ri  =  {oo}  =  typ€{(), 
where  e  is  the  empty  string  and  we  use  the  fact  that 


D"(jr,  Oo)  =  Ti . . .  7r„), 


we  obtain  d"(ao)  =  ^"(1). 

We  now  define  the  piecewise  linear  operator  i  —*  by  defining  the  sth  coor¬ 
dinate  of  $  : 

$,(x)  =  max 
»<»■<« 

The  optimality  equation  may  be  expressed  as 


yn+l  _ 
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V"(l)  is  the  first  coordinate  of 


(T  =  (3) 

where  d°  is  the  vector  of  all  I's.  We  define  d(s)  =  rate{d"(s)}  where  s  is  the  sth 
coordinate  in  (3.)  In  [5],  a  partial  order  on  coordinate  indices  is  defined:  so  ^  s„  if 

for  some  choice  of  indices  ri.si,. , .,r„,Sn-i-  The  control  array  ^  is  connected  if  the 
equivalence  relation  obtained  by  defining  indices  s  and  t  to  be  equivalent,  if  s  ^  t  and 
t  ^  s,  has  only  one  component.  In  [5],  Wittbold  shows  that  d(s)  =  d(t)  for  all  indices 
s  and  t  if  the  control  array  is  connected.  The  equivalence  class  containing  an  index  s  is 
denoted  by  [s].  We  define  the  operator  ^  -*  hy  defining  the  stk  coordinate  of 

#  : 

*,(l)  =  max  <  M''; ».  l)*i  1  . 

1.6W  J 

if  1  <  s  <  /.  Let  be  the  vector  with  /  components  all  equal  to  1.  We  define  d"  = 

We  denote  the  sth  coordinate  of  d"  by  d”(s).  We  also  define 

d(s)  =  rfl<e{d”(s)}; 

we  then  have  the  following  proposition  from  [5]. 

Proposition  2.4  Let  n  be  a  control  array,  and  let  s  be  a  coordinate  index.  We  have 

d(s)  =  max  d(so)- 

{so'.r^fo) 


Thus  the  problem  of  computing  the  capacity  of  a  controlled  signalling  system  is  reduced 
to  computing  the  capacity  of  a  controlled  signalling  system  with  a  connected  control 
array.  The  control  array  n  is  positive  if  all  the  elements  /i(r;s,t)  are  positive;  clearly 
any  positive  control  array  is  connected.  In  this  case,  the  common  value  is  denoted  by 
d(/i).  It  is  also  shown  in  [5]  that  any  connected  control  array  n  can  be  approximated 
by  a  positive  control  array;  there  exists  a  positive  control  array  fip  such  that  d(^p)  is  as 
close  to  d(p)  as  desired.  We  now  state  this  result; 


Proposition  2.5  Let  n  be  a  connected  control  array.  For  e  >  0,  we  define 


J  fiir;s,t)  ifn{r;3,t)> 

There  exists  a  constant  AT  >  0  such  that  for  all  c  >  0, 

^  f)- 
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We  will  now  give  a  definition  in  order  to  present  the  theorem  of  Bellman  [1]. 


Definition  2.14  We  let 

=  Ux,  >0,  l<s<T}. 

We  also  define  4> :  — ►  A^“*  by 

'  '  1  •  HP) 

where  1  denotes  the  vector  of  all  I's,  and  •  denotes  the  standard  inner  product. 


We  can  now  present  the  theorem  which  gives  the  capacity  of  a  controlled  signalling 
system  with  positive  control  array  as  the  log  of  the  largest  positive  eigenvalue  of  /i. 


Theorem  2.3  (Bellman  [1])  Let  /i  be  a  positive  control  array,  and  let  and  </>  be 
the  associated  operators.  Then 

1.  ♦  has  a  unique  eigenvector  e  €  A^“^.  Let  $(e)  =  Ae. 

2.  A  >  0  and  e  is  positive. 

3.  For  any  P  €  A^“^  we  have  /tm„_oo^"(-F)  =  e. 

4.  d{n)  =  log(A). 
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SECTION  3 

SERIAL  PRODUCTS  AND  AN  EXAMPLE 


We  will  now  define  the  serial  product  of  two  controlled  signalling  systems. 


Definition  3.1  (Serial  Product)  The  serial  product  of  two  controlled  signalling  sys¬ 
tems 

Si  =  {SiJi^Ji^,Oi,nexti,outi,ai^) 


and 


S2  =  (52,/2j.,/2R,02,neif2,0«f2,a2o) 
is  the  controlled  signalling  system 

<Si  X  <$2  =  {Si  X  52,/iy  U /27.,/iR  U /2h,0i  U  02,nexti2,outi2,{aiQ,a2^)) 


where: 


1.  5i  X  52  is  the  Cartesian  product  of  the  sets  Si  and  S2- 


2.  We  assume  /i^  H  /2^  =  0  amd  Iij.  n  I2J.  —  0. 

3.  We  define  Ii  =  U  Ii^,  I2  =  hn  U  hr^ 


nexti2{{si,S2),i) 


I  (nexti(si,i),S2)  if  t  e /i 
\  (si,next2(s2,i))  if  t  G /2. 


4.  We  define 


0«ti2((Si,a2),*) 


{outi(si,i)  if  t  G /i 
out2(s2,  i)  if  i  e  h- 


Let  TTi  be  a  strategy  for  the  controlled  signalling  system  5i.  It  is  trivial  to  extend 
iTi  to  a  strategy  jt  for  Si  x  52,  such  that  jr  agrees  with  jti  on  elements  of  (/i^  x  O)”  for 
all  n  >  0.  Thus  a  block-policy  code  Bi  for  5i  can  be  extended  to  a  block-policy  code  B 
for  Si  X  S2  by  replacing  state  6  with  state  (h,  oq),  extending  tti  as  above  to  a  strategy  tt 
on  5,  and  otherwise  leaving  B  unchanged.  The  code  B  has  the  same  rate  as  Bi.  Hence 
by  Theorem  2.1,  we  must  have 

cap{Si  X  S2)  >  max{cap{Si),cap{S2)}. 
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A  natural  question  at  this  point  is  whether  the  following  formula  holds: 


cap(Si  X  52)  =  mai{cop(5i),cap(52)}. 


(4) 


We  say  the  controlled  signalling  system  S  has  the  transmitter  (receiver)  self-loop  prop¬ 
erty  if  there  exists  i  €  It  (i  6  Ir)  such  that  si  =  s  for  all  states  s  €  5.  It  is  easy  to 
find  examples  of  controlled  signalling  systems  and  <^2  without  both  transmitter  and 
receiver  self-loop  properties  such  that  (4)  does  not  hold. 

The  following  example  will  show  that  (4)  does  not  hold  for  controlled  signalling 
systems  even  in  the  case  where  both  Si  and  St  have  transmitter  and  receiver  self-loop 
properties.  The  next  section  of  the  paper  will  be  devoted  to  finding  restrictions  on 
controlled  signalling  systems  that  will  allow  us  to  prove  a  formula  similar  to  (4.) 


We  let 


where  Si  =  {0, 1,2, 3, 4, 5, 6, 7, 8},  Ay  =  {t;,u>,x,y,z},  =  {a,  6},  and  Oi  =  {1,2} 

(see  figure  1).  For  i  6  Ir, 


1  * 

nexti(s,i)=<  5 

6 


if  s  =  6,t  =  6 
if  s  =  5, »  =  6 
if  s  6  {1,2},»  =  b 
if  s  €  {3,4},!  =  b 
otherwise. 


For  i  ^  It,  the  next  function  is  described  by  the  unlabeled  edges  in  figure  1.  An  edge 
directed  from  state  s  in  the  figure  to  state  t  defines  next(s,  t)  =  t  for  at  least  one  t  €  It- 
Since  there  are  at  most  5  unlabeled  edges  leaving  any  state  and  |/t|  =  5,  this  definition 
is  satisfactory.  For  i  €  //j,  we  have 


if  s  =  2,  i  =  6 
if  s  =  4,  i  =  6 
if  s  =  6,»  =  6 
otherwise. 

For  i  €  It,  and  s  €  S',  we  define  outi(s,t)  =  1.  Also,  ai^  =  0. 

The  transmitter  outputs  of  a  controlled  signalling  system  play  no  role  in  the  argu¬ 
ments  of  this  paper  or  in  [5].  In  figure  1,  an  edge  with  label  i/o  directed  from  state  s  to 
state  t  gives  that  nexti(s,  i)  =  t  and  ottfi(s,t)  =  o.  As  mentioned  above,  unlabeled  edges 
correspond  to  transmitter  inputs  into  the  next  function.  We  let  37  be  an  isomorphic 
copy  of  Si . 


outi{s,i)  = 
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We  will  now  prove  that 


cap{Si  X  >  caj^Si),  (5) 

thus  showing  that  (4)  does  not  hold  for  controlled  signalling  systems. 

Before  giving  this  proof,  we  will  ^ve  an  intuitive  explanation.  We  imagine  5i  and 
a  copy  of  «Si  side  by  side.  Both  systems  are  initially  in  state  0.  The  transmitter  uses 
an  input  in  «$i  that  causes  a  transition  into  one  of  the  states  1,  2,  3,  or  4.  The  receiver 
then  uses  the  input  6  in  «Si.  The  state  of  Sy  is  now  5  or  6.  The  reader  can  see  from 
figure  1  that  the  transmitter  is  forced  to  waste  a  move  in  both  states  5  and  6  when  the 
transmitter  is  on  «Si.  Thus  it  pays  for  the  transmitter  to  temporarily  switch  over  to 
the  other  copy  of  Sy  when  the  first  copy  of  Sy  is  in  state  5  or  6.  The  transmitter  now 
repeats  the  same  steps  for  the  copy  of  <Si  -  as  for  Sy .  Similarly,  the  receiver  must  waste 
a  move  in  states  7  and  8  since  the  only  possible  output  in  response  to  its  input  is  a  1; 
thus  the  receiver  should  temporarily  switch  to  the  other  copy  of  Sy  when  the  first  copy 
of  Sy  is  in  state  7  or  8. 


We  now  give  the  proof  for  (5).  By  Theorem  2.2,  we  have 

V-{0) 


=  max  < 

•€/«  1 


Y. 

o€0(«OT>e(/J),»)  J 


for  all  receiver  output  strings  /?.  We  claim  that  i  =  6  in  the  above  equation.  The 
following  proposition  wiU  prove  an  equivalent  statement. 


Proposition  3.1  Let  5i  be  the  controlled  signalling  system  defined  above.  We  then 
have 

Y,  V\0ho)>  F*(^al)  (6) 

o€O(t]fpe(0),b) 

for  all  integers  k  >0. 


Proof:  We  use  induction  on  k  for  the  proof.  The  proof  of  the  1:  =  0  case  is  immediate 
since  V®(a)  =  1  for  all  receiver  output  strings  a.  Suppose  the  result  holds  for  integers 
less  than  k. 


Case  a  {7, 8}  n  type{0)  =  9 
We  notice  that 

{stitj :  *i,t2  e  It}  =  {«’  •• »  e  It}, 

for  states  s  of  «Si,  where  s  ^  7  and  s  ^  8.  Also  sa  =  s  for  all  states  of  <5i;  in  other 
words,  a  is  a  receiver  self-loop  for  aU  states  s  of  <S].  We  claim  these  two  facts 
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imply  <ype(/?6l)  =  type{Palhl)  if  1  €  0{type{^),b),  and  typ€{/3b2)  =  typ€{Palb2) 
if  2  6  0{typ€{/3),b).  We  will  prove  the  first  assertion;  the  proof  of  the  second 
assertion  follows  similarly.  We  have 

type(0al)  =  {tn  :  there  exists  x  6  type{0),  hi  6  It 

such  that  xhia  =  w  and  out{xhi,a)  =  1, } 

=  {w  :  there  exists  x  6  type{0),  hi  €  It 

such  that  xhi  =  (7) 

where  the  first  equality  follows  from  Proposition  2.3.  We  also  have 

type{0albl)  =  {s  :  there  exists  w  €  typ€{0al),  h  £  It 
such  that  whb  =  s  and  out{wh,b)  =1} 

=  {s  :  there  exists  x  e  type{0),  h,hi  €  It, 

such  that  xhihb  =  s  and  out{xhih,b)  =  1}  (8) 

=  {s  :  there  exists  i  e  iype{0),  h  €  It, 
such  that  xhb  —  s  and  out{xh,b)  =  1} 

=  typ€{0bl), 

where  the  first  and  last  equalities  foUow  from  Proposition  2.3.  The  second  equality 
(8)  follows  from  substituting  (7)  into  the  first  line;  and  the  third  equality  follows 
from  the  two  facts  above.  We  now  finish  the  proof  of  Case  a.  If  we  apply  the 
definitions  of  V’*+*  and  and  use  the  fact  that  \Ext^{Q)\  >  \Q\  for  aU 

nonempty  sets  Q  C  Sig”'{ao),  we  obtain  >  V^{Q)  for  n  >  0.  Thus 

53  y''(/36o)  >  53  V'’-\0bo) 

o^O(type(0),b)  oeO{type{0),b) 

=  E  V>‘-\0albo) 

oeO(type(0al),b) 

=  V^(0al) 

where  the  last  equality  follows  by  the  inductive  hypothesis,  and  the  previous  equal¬ 
ity  follows  by  the  results  above  and  Theorem  2.2.  We  have  proved  Proposition  3.1 
where  {7,8}  n  typ€{0)  =0. 

Case  b  {7,8}  D  typ€{0)  ^  0 
We  first  show  that 

type(0albl)  C  type{0blbl).  (9) 
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By  applying  Proposition  2.3  twice,  we  obtain 

type{Pblbl)  =  {s  :  there  exists  x  €  typ€{p),  h,hi  6  It 
such  that  xhibhb  =  s,  out{xh\,b)  =  1, 
and  out{xhibh,b)  =  1}.  (10) 

The  expression  for  typ€{0albl)  is  given  in  (8)  above;  let  x  £  type{^).  If  i  =  7, 
then  {0,5, 6, 7}  C  type{fia\b\),  and  {0,5,6, 7}  C  typ€{^blb\).  The  same  holds 
if  X  =  8  with  {0,5, 6, 8}  in  place  of  {0,5,6, 7}.  Thus  x  £  type{fia\bl)  implies 
I  €  type{0b\bl)  if  i  €  {7,8}.  Since  typ€{l3)  n  {7,8}  ^  0,  the  preceding  argument 
shows  that  {u,5,6}  C  typ€{0blbl).  Also,  {1,2,3,4}  n  tj/p€(/?al&l)  =  0.  We  have 
proved  (9.) 

We  will  now  show  that 

typ€(Palb2)  C  type(liblb2){J  type{^b2b\).  (11) 

We  apply  Proposition  2.3  twice  to  obtain  expressions  for  type(/dal62),  type{j3b\b2), 
and  type{0b2b\)  as  in  (10)  above.  The  definition  of  Si  shows  that  typ€{l3alb2)  C 
{5,6,8}.  Since  {7,8}  0  type^fi)  0,  we  have  {5,6}  C  tj/pc(/36l62).  Suppose 
8  €  type{0alb2).  Proposition  2.3  shows  that  6  €  type(/3);  thus  8  €  type(/j6251). 
The  proof  of  (11)  is  complete. 

To  complete  the  proof  of  Case  b,  we  need  the  following  fact.  Let  a,  0i,. .  .,(3rn  be 
receiver  output  strings  such  that  typ€{a)  C  U-litype(/?,)  where  m  >  1.  We  then 
have 

(12) 

i=l 

for  n  >  0.  We  can  prove  (12)  by  induction.  The  inductive  step  is 
V*(a)  =  inax  ^  ^^“'(oto) 

o€0((vpe(a),i) 

=  E  v'‘-‘ (<»''») 

oeO(lvi>e(o),«') 

o€0(rvpe(P,  ).«'))=* 

J=I 

for  some  i'  £  In.  The  first  and  last  inequalities  are  due  to  Theorem  2.2.  Hence 

V‘(/36o)  =  Yi  L  V^*-‘(|36o6o')  (13) 

oeO{type{0),b)  oeO{tyi>e{0),h)  o’^O{typt{0bo),b) 
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(14) 


>  ^  K*-^(/?al6o) 

oeO{type(0a\),b) 

=  V\0al)  (15) 

where  (13)  and  (15)  follow  from  the  inductive  hypothesis  and  (14)  follows  from 
(9),  (11),  and  (12)  above. 


The  proof  of  Proposition  3.1  is  complete.  □ 

We  wiU  now  use  Proposition  3.1  to  show  that  cap(5i)  <  1. 


Proposition  3.2  If  Si  is  the  controlled  signalling  system  defined  above,  we  nave 

cop(5i)  <  1. 

Proof:  Let  tSJ  be  the  controlled  signalling  system  obtained  by  removing  a  from  in 
the  controlled  signalling  system  5i.  The  next  and  out  functions  for  are  obtained  by 
restricting  the  domain  of  nexti  and  outi  for  Si  to  =  {6}.  Let  P  =  boi .  ..bom,  where 
€  0i  and  m  >  0.  Proposition  2.1  combined  with  Definitions  2.7,  2.9,  and 
2.10  shows  that  /3  is  a  receiver  output  string  in  Si  if  and  only  if  /?  is  a  receiver  output 
string  in  5{ .  If  /?  is  a  receiver  output  string  and  n  >  0,  we  claim  that 

V^iSuP)=:V^{S[.P).  (16) 

(16)  can  be  established  by  induction  on  n.  For  the  inductive  step,  we  apply  Proposi¬ 
tion  3.1  to  obtain 

V-{Si,P)=  Yi  V--\Si,Pbo).  (17) 

o^O{typt{0),b) 

We  write  typ€{S,P)  in  place  of  type(/?)  in  S  for  a  controlled  signalling  system  S.  It 
is  easy  to  check  in  Definitions  2.9  and  2.10  that  hi...hm  G  Ij  is  consistent  with  P 
and  oohiii  ...hnin  =  a  in  if  and  only  if  the  same  holds  in  Thus  type{Si,P)  — 
typ€{S[,P)  and  0{typ€{Si,P),b)  =  0{type{S[,P),b).  We  can  now  apply  the  inductive 
hypothesis  to  (17)  to  prove  (16). 

If  we  apply  (16)  to  the  empty  string,  we  get 

r"(5i,€)  =  K’‘(5;,e) 

for  n  >  0.  Since  cap{S)  =  ratc{V'’*(5,€)}  for  a  controlled  signalling  system  S,  it  suffices 
to  show  cap(5i)  <  compute  the  control  array  pi>  of  The  next 

definition  will  be  helpful  in  this  regard. 
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Definition  3.2  (Type  tree)  A  type  tree  of  a  controlled  signalling  system  S  is  any 
rooted  tree  with  labelled  vertices  having  the  foUowing  properties.  The  root  has  label 
(c.oo)  where  oq  is  the  initial  state  of  S.  In  general,  a  vertex  v  of  the  tree  is  labeUed 
with  (to  :  si, . .  .,Sfc)  where  o  €  O  (O  is  the  set  of  output  symbols  for  S),  i  €  Ir,  and 
si,...,Sk  are  states  of  S.  The  set  is  called  the  second  part  of  the  label, 

and  to  is  called  the  first  part  of  the  label.  Such  a  vertex  v  has  (t'lOi  :  ti,. .  .,tp)  as  the 
label  of  a  child  only  if  for  each  tj,  1  <  j  <  p,  there  exists  h  £  Ij  and  I,  I  <  I  <  k 
such  that  sihii  =  tj  and  out(s/h,t/)  =  oj.  For  any  type  tree  T  for  S  which  has  a  vertex 
with  {si,...,Sfc}  as  the  '"cond  part  of  its  label,  there  exists  exactly  one  vertex  with 
{si , . . . ,  as  the  second  part  of  its  label  that  has  children  in  T. 

« 

Let  be  a  controlled  signalling  system  with  type  tree  T.  Let  Ir  =  {I'l, . . .,  i/j}. 
Proposition  2.3  shows  that  every  type  t  of  S  must  occur  as  the  second  part  of  the  label 
for  some  vertex  v  in  T  and  that  for  every  vertex  t;  in  T  the  second  part  of  the  label  of 
u  is  a  type  of  S.  Let  v  be  the  vertex  in  T  that  has  children  such  that  the  second  part 
of  the  label  of  v  is  s.  The  control  array  definition  shows  that  p{r,  s,  t)  is  the  number  of 
children  w  that  v  has  in  T  where  the  second  part  of  the  label  of  tn  is  t  and  the  first  part 
of  the  label  of  tv  is  t,o.  If  we  apply  these  facts  to  we  obtain  the  control  array  of  S'l’. 


‘0110 
0  0  0  1 
0  0  0  0 
0  0  0  1 
0  0  0  0 
0  0  0  0 
0  0  0  0 
0  0  10 
0  0  11 
0  0  10 
0  0  0  0 
0  0  0  0 


0  0  0  0 
10  0  0 
0  110 
10  0  0 
0  0  11 
0  0  0  0 
0  0  0  0 
0  0  0  0 
0  0  0  0 
0  0  0  0 
10  0  0 
10  0  0 


0  0  0  0  1 
0  0  0  0 
0  0  0  0 
0  0  0  0 
0  0  0  0 
10  0  0 
0  10  0 
0  0  0  1 
0  0  0  0 
0  0  10 
0  0  0  1 
0  0  0  1 


By  applying  the  definition  of  the  equivalence  relation,  we  see  that  s,  t)  has  3 
connected  components,  {!},  {2},  and  {3,4,5,6,7,8,9,10,11,12}.  The  first  two  compo¬ 
nents  are  1  X  1  zero  entries;  thus  Proposition  2.4  gives  that  cap(5{)  =  d(/l)  where  fi 
is  the  matrix  obtained  from  pi<(b;s,t)  by  eliminating  the  first  two  rows  and  columns. 
Let  €  >  0.  By  Theorem  2.3,  is  the  log  of  the  largest  positive  eigenvalue  of  the 
matrix  /i'  which  is  obtained  by  adding  c  to  the  zero  elements  of  p.  Since  the  eigenvalues 
of  a  matrix  depend  continuously  on  the  matrix  entries  (e.g.  [2]),  the  largest  positive 
eigenvalue  of  /i*  approaches  the  largest  positive  eigenvalue  a  of  ^  as  e  goes  to  zero.  By 
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Proposition  2.5,  d(Ai*)  approaches  d{fi)  as  e  goes  to  zero.  The  combination  of  these  facts 
implies  that  d{p)  =  log(a).  Since  /i  is  a  connected  component  of  the  control  array  /z,  fi 
is  an  irreducible  matrix.  Thus  nonnegative  matrix  theory  (Chapter  2  of  [3])  gives  that 
a  is  less  than  2  since  the  largest  positive  eigenvalue  of  an  irreducible  matrix  is  less  than 
or  equal  to  the  largest  row  sum  of  the  matrix  with  equality  if  and  only  if  all  row  sums 
are  equal.  We  have  proved  that  cap(Si)  <  1.  □ 

To  complete  the  proof  of  (5),  we  wiU  show  that 

cap(Si  X  5i)  >1  (18) 

where  5i  is  an  isomj^rphic  copy  of  5i  (we  obtain  Si  by  adding  overlines  to  the  input, 
output,  and  state  sets  of  <Si).  By  Theorem  2.1,  it  suffices  to  exhibit  a  block-policy  code 
for  Si  X  Si  with  a  rate  arbitrarily  close  to  1.  We  construct  block-policy  codes  B„  with 
rates  4n/(4n  -b  1)  where  n  >  1  : 

Definition  3.3  We  define 


where 


Sn  =  (ao,4n,4n-b  l,A’„,ir„) 


1.  oo  =  (0, 0)  is  the  initial  state  of  Si  x  Si. 


2.  JT^n-n  €  n^n+i  is  defined  by 


6 

b 


if  k  mod  4  €  {2,3} 
oi  k  =  4n 
otherwise. 


3.  Let  the  transmitter  input  h  in  <Si  where  next{l,h)  =  0  be  denoted  by  w.  We 
say  that  w  causes  the  transmitter  input  transition  7  — ►  0.  We  may  also  assume 
that  w  causes  transmitter  input  transitions  8  — ►  0,  0  -♦  1,  5  — ►  5,  and  6  — ►  6. 
Let  X  cause  transmitter  input  transition  0  — ►  2;  we  let  y  cause  transmitter  input 
transition  0  — ►  3.  Let  z  cause  transmitter  input  transition  0  — ►  4.  We  make  the 
same  definitions  in  Si  by  adding  overlines  to  the  above  definitions.  We  define 
hi ...  /»4„+i  €  Xn  if  and  only  if  for  1  <  t  <  4n  -b  1, 

’  tiiJ  if  i  mod  4  =  1  and  i  ^  1, 

or  i  =  4n 

^  if  i  mod  4  =  3 

’  ~  w,x,  y,  or  z  if  *  mod  4  =  0  and  i  ^  4n, 
or  i  =  1 

,  Io,T,y,  or  7  if  t  mod  4  =  2. 
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It  is  easy  to  check  that  5„  is  a  block-policy  code  with  rate  4n/(4n  +  1)  for  n  >  1.  We 
have  established  (18);  thus  (5)  follows  from  Proposition  3.2. 
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SECTION  4 

R-CONTROLLED  SIGNALLING  SYSTEMS 


In  this  section,  we  define  a  restricted-controlled  signalling  system,  or  r-controlled 
signalling  system  (r-css),  establish  the  structure  of  the  P-control  array,  and  state  and 
prove  a  product  theorem.  The  r-controlled  signalling  systems  are  a  subclass  of  the 
class  of  controlled  signalling  systems  for  which  (4)  holds.  We  will  see  that  in  the  serial 
product  of  r-controlled  signalling  systems,  the  P-types  play  the  same  role  as  the  types 
do  in  the  analysis  in  Section  2.  The  P-types  turn  out  to  be  Cartesian  products  of  types 
of  the  individual  systems  in  the  product;  we  are  therefore  able  to  decompose  the  serial 
product  of  r-controlled  signalling  systems. 


Definition  4.1  (r-css)  An  r-controlled  signalling  system  is  a  controlled  signalling  sys¬ 
tem  with  the  following  additional  two  properties: 

1.  If  there  exists  hi,h2  €  It  and  states  €  5  such  that  next(s,hi)  =  t  and 
next(t,h2)  =  u,  then  there  exists  h  €  It  such  that  next{s,h)  =  u. 

2.  For  each  s  €  5,  there  exists  t,  €  It  such  that  next{s, »,)  =  a. 


All  the  results  from  Section  2  must  therefore  hold  for  r-controlled  signalling  sys¬ 
tems.  We  note  that  the  product  of  r-controUed  signalling  systems  is  in  general  not  a 
r-controlled  signalling  system. 

Definition  4.2  (P-types)  Let  S\  and  Sj  be  r-controlled  signalling  systems.  Let  /3  = 
I'lOi . .  .I’nOn  be  a  receiver  output  string  for  the  controlled  signalling  system  Si  x  S2. 

P-typ€{(3)  =  {a  €  5  :  there  exists  hih2  .../»„€/? 

such  that  hih2...hn  is  consistent  with 
0,  Oohii'i . .  .hn*n  =  a,  and  hj  G  Iij. 
if  and  only  if  ij  G  /i^,  1  <  i  <  n}. 

It  is  easy  to  construct  examples  such  that  P-type{/3)  ^  typ€{l3)  where  is  a  receiver 
output  string  for  the  controlled  signalling  system  <5i  x  <S2. 
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Lemma  4.1  Let  «S  =  «Si  x  be  the  product  of  the  r-controUed  signalling  systems  Si 
and  <53,  and  let 

(3  —  tiOi ...  ifiOfi 

be  a  receiver  output  string  for  S.  Let 

®  —  •Vi  Orj  •  .  .  tVni  ®rin 

be  the  string  obtmned  by  deleting  the  symbols  of  73^  and  /2^  from  13.  Let 

7  — 

be  the  string  obtained  by  deleting  the  symbols  of  Iij.  and  /i„  from  Then  a  € 
•S’*5”*(aio)  and  7  €  Sig‘(a2o).  Also 

P-type{l3)  =  type(a)  x  typei'y). 

Conversely,  if  a  €  Sig”'{aig)  and  7  6  Sig‘(a2^),  then 

/?  =  07 

is  a  receiver  output  string  for  S  such  that 

P-type{0)  =  type{a)  x  type(7). 

Proof:  We  first  show  that  the  string  a  obtained  by  deleting  the  symbols  of  hr  and  hn 
from  S  satisfies  a  €  Sig”'{ai^ ).  There  exists  a  strategy  t  for  S  and  hi  ...h^  €  (/i  j,U/2j, )" 
such  that 

^(’'■■(“lO'Ojo))  (^1  — ^n)  =  {*lOl  •  •  •*nOn)- 

For  1  <  j  <  m,  we  let 

ind,j  =  {r  :  rj_i  <  v  <  rj  and  h„  €  hr) 

where  we  define  ro  =  0.  Let  /»j, , . . . ,  h,  be  an  enumeration  of  the  set  indr^  where 
ji  <  ...<  Let 

{ejjj)  =  endpt{ir,{ai^,a2o);hi...hr^), 

1  <  j  <  m,  and  let  eo  =  a^g.  Since  Si  is  an  r-controUed  signalfing  system,  there  exists 
gj  €  hr  such  that 

1  <  j  <  m.  If  indr^  is  empty,  we  let  gj  =  *e^_,  where  =  Cj-i,  I  <  j  <  m.  Thus 

* '  ‘9”*)  =  *riOri  •  • 
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where  ir\  is  a  strategy  for  <5i  such  that 

^l(*rjOri  •  •  •  *r,_i  0r,_,  )  =  tr,, 

1  <  t  <  m.  We  have  proved  that  a  is  a  receiver  output  string  for  S\.  The  same  argument 
shows  that  7  is  a  receiver  output  string  for 

We  now  prove  that 

P-typ€(0)  =  typ€(a)  x  typei-y). 

Let  (tijtj)  €  typ€{a)  x  type^y).  Thus  the  types  definition  gives  that  there  exists 
/i,j hrj  •  •  •  hr„  €  such  that  /i,j hr, ... hr„  is  consistent  with  a  and 

Also,  there  exists  such  that  /»,, hs,  ... hs,  is  consistent  with  7  and 

It  is  easy  to  check  that  (ti.tj)  €  P-type{P)  since  hi...hn  is  consistent  with  (3, 

flohiij  ...hnin  = 


and  hj  €  Iij.  if  and  only  if  ij 

Let  (ti,/2)  €  P-type{P).  Thus  there  exists  consistent  with  /3  such  that 

oo/tit'i  =  (<1,^2)  and  hj  6  if  and  only  if  ij  G  ^  j  S  It  is  easy  to 

check  (Definition  2.9)  that  hr^  . .  .hr„  is  consistent  with  a  and  oo/in  iri  •  •  •  • 

Hence  ti  €  type{a).  The  same  argument  shows  that  t2  G  iyp^il)- 


We  now  prove  the  converse;  let  q  and  7  be  receiver  output  strings  for  5i  and  ^2, 
respectively.  Thus  there  exist  finite  strategies  tti  and  ir2  for  5i  and  52,  respectively,  and 
hi...hn€  and  h^+i  •  •  -hm+i  €  /jj.  such  that 

^(iTj  ,oiq)  (^I  •  •  -^m)  —  O 

and 


Let 


’Ti  —  JtJ,.  .  .,ir 


1 

m 


and 


"2  —  'rj,...,^, 
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where  t]  :  (/j^  x  Oy~^ 
then  have 


Iin  and  vl :  (/j^  x  0)*“^  —*■  /jj,,  l<j<Tn,  l<k<l.  We 

-r  *  —  -.-I  *-2  S.2 

"2  —  •  •  •»  "m*  "!» •  •  •  >  "/ 


where  we  define 

=  1  <  i  <  / 

for  X  €  {Ir  X  O)"*  and  y  €  (/j^  x  0)'^“^.  It  then  follows  that 


*"(»!, irj.  (<>ia.a3o))  (^1  •  •  •^m+/)  —  «7- 

Thus  =  07  is  a  receiver  output  string  for  Si  x  S^-  The  first  part  of  the  lemma  now 
shows  that  P-type(l3)  =  iype{a)  x  type('j).  □ 


Proposition  4.1  Let  <Si  amd  ^2  be  r-controUed  signalling  systems  and  let  S  =  Si  x  S2. 
Let  hi  ...kn  be  consistent  with 


0  —  *1®1  •  •  •  *nOn 


such  that 


Qohiii . , . hfiin  —  (^l*^2)" 


If  t„  €  /2fi,  (Iir),  there  exists  hi...hn  and  h  €  /ij.  (hr)  such  that  hi ...  h„  is  consistent 
with  0  and 

•  •  •  hnifih  —  (sij  S2) 

where  hj  €  Ii^  if  and  only  if  V  €  IiR,  1  <  j  <  n.  Thus 


O{typ€{0),i)  =  O{P-type{0),%). 


Proof:  To  prove  the  first  statement,  we  use  induction  on  the  length  of  /?.  We  will  prove 
the  case  where  i„  €  hn]  the  proof  of  the  other  case  is  analogous. 

Let  n  =  1.  If  hi  €  hri  fben  we  let  h  =  hf  where  z  =  endpt{aohiii)  and  zhz  =  z. 
We  call  h,  the  self-loop  at  state  z.  Suppose  hi  €  Aj..  We  let  h  =  hi  and  hi  =  h* 
where  z  =  020-  (We  recall  that  the  initial  state  is  (oio,02o).)  It  then  follows  that  hi  is 
consistent  with  0  =  Aoi  and  oohiAh  =  (si,S2). 

We  assume  the  result  holds  for  integers  less  than  n.  Let 

01  =  I’lOi  . .  .tn  -lOn-l. 

It  follows  that  hi . .  .h„-i  is  consistent  with  0i;  let 
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If  t„_i  €  I2r  the  induction  hypothesis  gives  that  there  exists  and 

g  €  I\r  {hj)  ®'ich  that  h\ .  ..hn-\  is  consistent  with  /3i  and 

oohiix . .  .hn-iin-\9  =  (^1,^2) 

where  hj  G  Ii^  if  and  only  if  ij  €  /ir,  1  <  j  <  n  -  1.  Let 

(21,22)  =  endpt{aQhiix . . 


Case  a  hn  €  and  i„_i  €  hn-  Thus  g  6  Ixt-  We  let  =  /»„  and  h  =  g.li  is  easy 
to  check  that  out{22hn,in)  =  On  and  22hn*n  =  -»2-  Since  hn  €  hri  *n  €  hni  and 
h  €  hri  jt  follows  that  Si  =  ti.  Thus  the  proof  follows  in  this  case. 

Case  b  An  €  /2j.»  *n-i  €  Ixr-  Thus  g  €  hr-  We  have  si  =  ii  =  21  and  we  let  h  be  the 
transmitter  self-loop  for  si.  Since  S2  is  a  r-controlled  signalling  system,  we  may 
choose  hn  such  that  Z2ghn  =  22h„.  We  have  out{22hn,in)  =  ©n  and  22h„i„  =  S2. 
The  proof  of  case  b  now  follows. 

Case  c  €  /ij.i  *n-i  €  /2i,.  Thus  g  €  /ij.*  We  choose  to  be  the  transmitter  self¬ 
loop  for  state  22.  We  have  22*11  =  S2-  Also,  out{22hn,in)  =  On-  We  define  h  such 
that  Zxghn  =  2ih.  Thus  2xh  =  sx  and  the  proof  of  case  c  follows. 

Case  d  hn  €  /ij.,  *n-i  €  Ixr-  Thus  g  €  hr-  Let  =  g.  We  let  h  =  /i„.  We  have 
22hn  =  <2-  Thus  <yut{22hn,in)  =  o„.  Also,  2i/i  =  si.  The  proof  of  case  d  follows. 

We  now  prove  the  second  part  of  the  proposition.  We  have 

0{P-typ€{P),i)  C  Oityp€{p),i) 

since  P-type^P)  C  type^ji).  For  the  other  direction,  let  o  G  C?(type(/?),  i).  Without  loss  of 
generality,  we  may  assume  *  G  Ixr-  There  exists  (si,  S2)  6  type{P)  and  h  G  Aj.  such  that 
oiil((si,S2)Aj*)  =  o.  By  the  first  part  of  the  proposition,  there  exists  (A,  A)  €  P-type{(i) 
and  h  €  It  such  that 

Suppose  h  G  At-  We  then  have  txh  =  si  and  oui(txhh,i)  =  o.  There  exists  hx  such 
that  out(txhx,i)  =  o.  Thus  o  G  0(P-type(^),i). 

Suppose  h  G  Aj-.  We  then  have  AA  =  and  ti  =  Si.  Thus  o  G  0(P-typ€(f3),  i).  □ 


Proposition  4.2  (P-type  growth  properties)  Let  Sx  and  52  be  r-controUed  sig¬ 
nalling  systems.  Let  /?i  and  ^2  be  receiver  output  strings  for  5i  x  52  such  that 
P-type{0x)  =  P-typ€{02)-  Let  *  G  Ir. 
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1.  We  have 

0(type(/3i),  t)  =  0{type{l3-i),  i). 

2.  Let  *■  €  /i«,  and  o  e  0{typ€(Pi),i).  K 

P-typ€(0i)  =  typ€{a)  x  typc(7) 
then  o  €  0(type{a),  i)  and 

P-typ€(0iio)  =  type{aio)  x  type{')). 

An  analogous  statement  holds  if  i  e  I2k- 

3.  Let  o  €  0{type{P\),i).  We  have 

P-typ€(0iio)  =  P-typc(/?2»o). 

Proof:  The  proof  of  the  first  statement  follows  immediately  from  the  last  statement 
of  Proposition  4.1  and  the  fact  that  P-type(Pi)  =  P-type^^^)-  The  proof  of  the  second 
statement  follows  immediately  from  Lemma  4.1.  The  proof  of  the  last  statement  follows 
immediately  from  the  second  statement.  □ 


Definition  4.3  (P-control  array)  Let  S\  and  ^2  be  r-controlled  signalling  systems 
and  let  S  =  S\X  S2-  Let  wi , . . . ,  w/  be  an  enumeration  of  the  P-types  of  S.  Let  ij , . . . ,  i/j 
be  an  enumeration  of  the  receiver  input  alphabet.  We  define  the  following  array  of 
integers  to  be  the  P-control  array  of  S  : 

/i(r;  Wi,  Wj)  =  |{o  :  0irO  €  /?  has  length  m, 

P-typ€{P)  =  Wi,  and  P~typ€{f}iro)  =  Wj}) 


for  1  <  i,j  <  I  and  1  <  r  <  P. 


Proposition  4.2  shows  that  the  P-control  array  is  well-defined. 


Lemma  4.2  Let  S\  and  ^2  be  r-controlled  signalling  systems  and  let  S  =  Si  x  S2-  Let 
01  and  02  be  receiver  output  strings  for  S.  We  also  let  wi .  ..wi  be  an  enumeration  of 
the  set  of  P-types  of  S.  We  have: 

1.  For  n  >  0,  =  V'^{02)  if  P~ty‘pe[0i)  =  P-type{02).  Thus  the  V”’s  are 

well-defined  on  the  set  of  P-types. 
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2.  Let  u;  be  a  P-type.  For  n  >  1, 


I 

j=i 


Proof:  Theorem  2.2  gives  that 

F’*(/3)  =  max  Y1  (19) 

o€0{type{P),ir) 

for  receiver  output  strings  /3  and  n  >  1.  We  may  now  prove  the  first  statement  of  the 
lemma  by  induction  on  n.  The  induction  step  follows  by  applying  the  first  and  last 
statements  of  Proposition  4.2  to  (19).  For  the  second  statement  of  the  lemma,  we  fix 
an  output  string  0  of  P-type  w.  Since  the  number  of  terms  on  the  right-hand  side  of 
(19)  of  a  fixed  P-type  wj  is  the  proof  of  the  second  statement  follows  from 

(19).  □ 

Let  Ir  =  {«!,..., *«}  for  a  controUed  signalling  system  Si-  We  define  C(r)  = 
[/i(r,s,t)],  1  <  r  <  iZ.  We  say  that  Si  has  control  array  (7(1), . . .,(7(/). 


Theorem  4.1  Let  5i  and  52  be  r-controUed  signalling  systems  with  control  arrays 
4(1),...,  A{1)  and  J3(l), . . . ,  B(m),  respectively.  Let  the  types  of  5i  and  52  be  si , . . . ,  Sp 
and  ti,. .  .,t,,  respectively.  We  choose 

^ j  X  )  •  •  •  f  ^  1  *  *  *  )  ^  f  *  *  *  9  ^  ^9 

as  our  ordering  for  the  P-types  of  5  =  5i  x  52.  Then  5i  x  52  has  P-control  array 


where 


/i(r,s,t)  = 


i4(r)  0 

0  4(r) 


0 

0 


!<»•</, 


0  0  •••  4(r)  J 


B{u)iilp  B{u)i2lp  •••  B{u)iglp 

B(u)2llp  B{u)22lp  •••  B{u)2glp 

B{xi)gllp  B{v,)g2^p  B{u)gglp  _ 


«  =  r  —  /,  I  +  I  <  r  <  I  m, 
and  Ip  is  the  p  x  p  identity  matrix. 
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Proof:  The  proof  follows  from  our  ordering  of  the  P-types  combined  with  the  second 
statement  of  Proposition  4.2.  □ 

We  are  now  in  a  position  to  prove  formula  (4)  for  r-controUed  signalling  systems. 

Theorem  4.2 

cap(Si  X  S2)  =  maz{cap(5i),cap(52)} 
where  5i  and  S2  are  r-controUed  signalling  systems. 

Proof:  Let  S  =  Si  x  Sq.  We  use  induction  on  n  to  prove  the  following  formula: 

V"(5;  a  X  t)  <  ^  V‘‘iSi;  s)V^-‘‘iS2;  t)  (20) 

fc=0 

where  s  and  t  are  types  for  Si  and  S2,  respectively.  The  n  =  1  case  is  straightforward 
and  is  left  to  the  reader.  Suppose  (20)  is  true  for  n  -  1. 


V’‘(5,sx0  = 

maxy^./j(r,s  x  t,w)V'*~^(S,w) 

lit 

(21) 

= 

Yin{r,s  X  t,xo)V”~^{S,w) 

Vt 

(22) 

'^n(r,s  X  t,wi  X  (5,  x  t) 

(23) 

< 

Y,  /ii(r, «^i)  E  )V^""'""(52;  t) 

Wl  fcssO 

g  t)'£^^i{f, s, wi)V'‘{Si;wi) 

k=0  wi 

n— 1 

(24) 

= 

k=0 

(25) 

k=0 


Equation  (21)  is  the  second  statement  of  Lemma  4.2.  In  (22),  f  is  the  maximum  r  value 
from  (21);  we  have  assumed  that  €  hn-  The  argument  is  the  same  in  the  case  where 
iV  €  hit-  Equation  (23)  follows  from  the  structure  of  the  P-control  array.  Inequality  (24) 
is  the  inductive  hypothesis  combined  with  the  fact  that  /i(r,  sxt,wixt)  =  Hi{r,  s,  wi) 
where  fii  is  the  control  array  for  Si.  Equation  (25)  foUows  from  applying  Theorem  2.2 
(the  optimality  equation).  Thus  we  have  completed  the  induction  proof  for  (20). 
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Theorem  2.1  gives  that 


cap{Si )  =  lim  sup  ( 26) 

n~*oo  n 

where  «Si  is  a  controlled  signalling  system.  Let  ci  =  cap(Si)  and  C2  =  cap{S2)-  We 
choose  c  >  max{ci,C2}.  By  (26),  we  can  choose  L  >  1  such  that  V'(5i,aij,)  <  2‘‘^  and 
V\S2,a2o)  <  2^®  for  /  >  L.  We  recall  from  section  2 

rate{Xn]  —  lim  sup  (27) 

n— »<x)  U 

for  any  infinite  sequence  {!„}.  We  choose  Af  >  1  such  that 

max{r^(,Si;aiJ,F^(52;a2o)}  <  M. 

<  £V*(5,;a,JV"-n52;a2o) 

fcsO 

L  n 

=  i;V*(5i;aio)V"-*(52;a2o)+  Y.  V‘‘{Si;ay,)V^~'‘{^2;a2,) + 

fcsO  kxn~L 

"e’  V*(5i;a,,)V--"(52:o2o) 

fc=r.+i 

<  Mil  +  1)1^(52:020)  +  M(L  +  l)F’’(5i;a,o)  + 

n—L—l 

2kc2(n—k)c 

fc=L+l 

<  M{L  +  l)V^"(5i:a,o)  +  M{L  +  l)F’‘(52;a2o)  +  {n~2L-  1)2^. 
If  {x„}  and  {y„}  are  infinite  sequences,  it  easy  to  show  that 

rate{i„  +  y„}  =  max{rotc{x„},  rate{y„}}.  (28) 

Equation  (28)  applied  to  the  last  member  of  the  previous  chain  of  inequalities  gives 

rate{K"(5;aio  X  a2o)}  <  max{ci,C2,c}  (29) 

=  c. 

Equations  (26)  and  (27)  applied  to  the  left  side  of  (29)  give  that 

cap{S)  <  c. 

The  proof  now  follows.  □ 

The  definitions  and  results  of  this  section  can  be  extended  to  products  of  n  r-  con¬ 
trolled  signalling  systems. 


We  now  have 
K"(5;aio  X  020 ) 
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